Developing a Gesture Based Remote Human-Robot Interaction System Using Kinect
نویسندگان
چکیده
Gesture based natural human-robot interface is an important function of robot teleoperation system. Such interface not only enables users to manipulate a remote robot by demonstration, but also ensures user-friendly interaction and software reusability in developing a networked robot system. In this paper, an application of gesture-based remote human-robot interaction is proposed using a Kinect sensor. The gesture recognition method combines depth information with traditional Camshift tracking algorithm by using Kinect and employs HMM in dynamic gesture classification. A Client/Server structured robot teleoperation application system is developed, which provides a favorable function of remotely controlling a dual-arm robot by gestural commands. Experiment results validate the practicability and effectiveness of the application system.
منابع مشابه
A Kinect-based Gesture Recognition Approach for a Natural Human Robot Interface
In this paper, we present a gesture recognition system for the development of a human-robot interaction (HRI) interface. Kinect cameras and the OpenNI framework are used to obtain real-time tracking of a human skeleton. Ten different gestures, performed by different persons, are defined. Quaternions of joint angles are first used as robust and significant features. Next, neural network (NN) cla...
متن کاملRecognizing Military Gestures: Developing a Gesture Recognition Interface
The field of robotics presents a unique opportunity to design new technologies that can collaborate with humans to solve interesting problems. This is especially important in cases where a task is too difficult or dangerous, such as war. This project serves to bridge a gap within the field of Human-Robot Interaction by presenting a robust gesture recognition interface that can recognize gesture...
متن کاملHuman-Robot Interaction by Understanding Upper Body Gestures
In this paper, a human-robot interaction system based on a novel combination of sensors is proposed. It allows one person to interact with a humanoid social robot using natural body language. The robot understands the meaning of human upper body gestures and expresses itself by using a combination of body movements, facial expressions and verbal language. A set of 12 upper body gestures is invo...
متن کاملBody Movement Analysis and Recognition
In this chapter, a nonverbal way of communication for human–robot interaction by understanding human upper body gestures will be addressed. The human– robot interaction system based on a novel combination of sensors is proposed. It allows one person to interact with a humanoid social robot with natural body language. The robot can understand the meaning of human upper body gestures and express ...
متن کاملA Robot Control System Based on Gesture Recognition Using Kinect
The Kinect camera is widely used for capturing human body images and human motion recognition in video game playing, and there are already some research works on gesture recognition. However, to achieve the anti-interference performance, the current recognition algorithms are often complex and tardiness, and most of the applications are based on the incomplete gesture library and not all hand g...
متن کامل